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A new method on deterministic construction of 
the measurement matrix in compressed sensing 

Qun Mo 


Abstract 

Construction on the measurement matrix A is a central problem in compressed sensing. Although 
using random matrices is proven optimal and successful in both theory and applications. A deterministic 
construction on the measurement matrix is still very important and interesting. In fact, it is still an open 
problem proposed by T. Tao. In this paper, we shall provide a new deterministic construction method 
and prove it is optimal with regard to the mutual incoherence. 
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I. Introduction 

Sparsity and compressed sensing have attracted a great deal of attentions recently. The key 
idea in compressed sensing [3], [8] is that if a signal x G R N is sparse, then we can exactly 
recover it from much fewer measurements b = Ax, where A G M" 1 x ;V is the measurement matrix 
and usually m <C N. 

To be more precise, we say x G R N is s-sparse if ||x || 0 < s, where ||x || 0 is the number of 
nonzero entries of x. Also, we say x is sparse if x is s-sparse and s -C N. In many applications 
like image processing, video processing etc, signals are often in a very high dimensional space, 
i.e., x e R N with a very large N. That is, a signal x usually has a huge mount of entries 
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unknown. It would take lots of effort to measure these entries if we measure them one by one. 
Fortunately, due to their natural structure, many signals are sparse or can be well approximated 
by sparse signals, either under the canonical basis or other special basis/frames. 

For simplicity, we assume that x is sparse under the canonical basis in M. N , that is, x = 
ELi x ik e 3k with 1 ^ ji < j 2 < ■ ■ ■ < j s ^ N. An important remark is that usually we do not 
have any prior information or assumption about the exact location of these nonzero entries of x. 
To retrieve such a sparse signal x, a natural method is to solve the following l 0 problem 

min ||a;||o subject to Ax = b (1) 

X 

where A and b are known. To ensure the s-sparse solution is unique, we would like to use the 
restricted isometry property (RIP) which was introduced by Candes and Tao in [4]. A matrix A 
satisfies the RIP of order s with the restricted isometry constant (RIC) 5 S = S s (/l) if 5 S is the 
smallest constant such that 

(1 - <5 s )||a;||! < \\Ax\\l < (1 + A s )||o:||| (2) 

holds for all s-sparse signal x. 

If <5 2 s (A) < 1, the l 0 problem has a unique s-sparse solution [4]. The l 0 problem is equivalent 
to the /( minimization problem when S 2 s (A) < a/2/2 , please see [2], [13], [1] and the references 
therein. 

Now it is natural to ask how to construct a desired measurement matrix. Using random matrix 
is proven to be very successful. Candes and Tao have proven the following theorem: 

Theorem 1.1. If the elements of a matrix A is independently drawn from the gaussian distribution 
Af(0,m/N), then with very high probability, we have <5 2s (A) ^ m/(s log N). 

A further conclusion of the above theorem is: If the elements of A is independently drawn 
from the gaussian distribution J\f(0,m/N) and m f Cs log A r with some constant C, then with 
very high probability, we have 5 2s {A) < y/2/2. 

Since reducing the number of measurements is essential in compressed sensing. It is highly 
desirable to construct a measurement matrix A £ M' ny ;V with m as small as possible while 
satisfying 5 2s (A) < \/2/2. From the other hand, it is also highly desirable to construct a 
measurement matrix A with optimal instances. It is proven [?] that to satisfy optimal instance, we 
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must have m ^ Cs log N with some constant C. Therefore, using random matrix to construct the 
measurement matrix A e R mxJV with m = Cs log N is optimal with regard to optimal instances. 

Although using random matrix is so successful, it is still very important and interesting to 
study deterministic constructions. In fact, it is still an open problem proposed by Tao. 


II. Mutual incoherence 


As mentioned before, <5 2s < 2~ 1/2 is a sharp sufficient condition. However, according to 
its definition, R.I.C. is very hard to calculate. On the other hand, another constant, mutual 
incoherence, is much easier to calculate. For a measurement matrix A, we denote /j,a the mutual 
incoherence by 


AC4 : = 


\{Ae h Aej) 
KKFSN 11^11211^112' 


max 


(3) 


It is proven by Tai and Wang [***] that if 


A ia < 1/(2 s - 1), 


(4) 


then the measurement matrix A is suitable for recovering every s-sparse signal x from b = Ax 
and the above condition is sharp. Now we will focus on how to construct a sensing matrix 
A e M mxAr suc h that (4) is satisfied. 

First of all, let us review the possible range of m when N and s are given. Define 


A t m,A r : — rnin Aem mxN/i A - (5) 

, By the famous Welch bound [***], we have 

I N — m 

S V (JV - 1 )m (6) 

However, it is not a sharp bound in some situations. For instance, if we fix m, then all the 
column vectors of A are in M m . Now when —> +00 , which means the number of column 
vectors of A goes to positive infinity, then the mutual incoherence of A will go to 1, since those 
column vectors of A are getting crowder and crowder in R m . That is, 

lim /x m ,N = 1 

N— >-+oo 

when m is fixed. If (6) is sharp, we would have 

lim /i m,N 

N —>+oo 



March 5. 2015 


DRAFT 



4 


which contradicts the above equality! As pointed out by [****], another bound is 

m^ClniV(-) 2 /ln(-) (7) 

/i fi 

where C is a constant independent of m, N and //. A remark of above bound is that it implies 
p —> 1 when m is fixed and N —> +oo. Also, it is still unknown whether the above bound is 
sharp. For all known constructions in the literature, we have 

\fm In m ^ C In N— (8) 

I 1 

Now we propose the following new construction method. This algorithm is a random algorithm, 
the possibility of this algorithm to succeed is very high. Moreover, if this random algorithm 

succeeds, we know for sure that the output matrix A will satisfy the condition /ia ^ — • 

2s 

Algorithm: 1. Input N and s. Fix the seed of a random generator. Choose m A [8.s- 2 ln(2s./V/7r)l + 
2 and define j = 0, x 0 = e\ G M m . 

2. Repeat the following: 

2.1 Let k := 0 and replace j by 3 + !• 

2.2 Replace k by k +1. Use the random generator to get a unit vector y e M m , then calculate 

fly := maxi^jKxi,y)\. 

1 

2.3 repeat 2.2 if n v > — and k < 10. 

2s 

3. Repeat 2 if k < 10 and j < N. 

Now we claim the following theorem: 

Theorem II.1. The possibility that the above algorithm find the desired sensing matrix is at least 
1 — 10 -4 . If the algorithm succeed, the worst computational complexity is 10 mN + N(N — l)/2. 

Proof: For a given unit vector x e R m , consider these two caps 

C x , 8 ■= {y e ® m ||M |2 = 1 and \(y,x)\ ^ l/(2s)}. 

By direct calculation, one can verify that the surface area A s rn of these two caps C x s satisfies 

A s ,m < 2s(l - l/(2s) 2 ) (m - 1)/2 C m _i. 

Therefore, the possibility of finding a wanted y such that 

\{y,Xi)\ < !/(2s) Vi = {1,2, — ,j} 
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is at least l—jA s m /A m > l-2js{l-l/{2s) 2 )^/ 2 V m ^/A m > l-2js(l-l/(^s) 2 )^/ 2 /(2 t:), 

which by direct calculation, is at least 1 — (j/(2iV)) 10 . Then the all claim can be verified by 
direct calculation. 

Remark II.2. It is only a very rough draft, a refined version with suitable citations will be 
updated soon. 
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